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(54) STEREOSCOPIC VISION CAMERA 

(57)Abstract: - 

PURPOSE- To provide a stereoscopic image signal witn 
one optical system by estimating image data recorded in 
a memory from picked-up images with a neural network. 
CONSTITUTION: A two-dimensional image signal is 
outputted from an imaging device 2 such as a CCD and 
inputted to a neural network 1 2. In addition to this two- 
dimensional image signal, image data in the past are 
fetched from a memory 1 1 to the neural network 12. The 
neural network 12 estimates the information required for 
preparing a stereoscopic image from these image data 
from learning in the past and transmits signals to an 
image synthesizer 13. Then, the image synthesizer 13 
synthesizes the estimated image signals and outputs 
stereoscopic image signals required for the stereoscop.c 
image. The outputted stereoscopic image signals are 
converted to stereoscopic image signals provtded with 
the vectors of X. Y and Z axes by a 3D image converter 
14 and outputted. Thus, the stereoscop.c .mage signal 

SSSEft t — . - *. v - z 

can be provided. 
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* NOTICES * 

The Japanese Patent Office is not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



rclaimnin the solid vision camera which outputs X, Y, and the solid picture signal with the 
Z If hfz-ax s The optical system which connects a focus to an image pck-up element and 

SffiS.?*— «* » ccD ' and the memory which records and 

reproduces an image pck-up picture image at any time, 
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3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 

[RekUrf the Invention] this invention relates to solid vision cameras, such as multimedia. 

[Description of the Prior Art] Conventionally, the solid vision camera caught the video signal with 
wo independent optical system, and made * the 3-dimensional-scenography signal That is .t 
consisted of the optical system of the image pck-up section which consists of CCD etc.. and the 
optical system of the distance instrumentation section which consists of photo detectors, such 
af light emitting devices, such as Light Emitting Diode, and a photo d.ode array, each s.gnal was 
compounded, and the solid picture signal had been acquired. 

[0003] The configuration of the conventional example ,s shown in dj*mgl . 1 is the .mage pck 
up se tion which consists of the image pck-up element 2 and the 6 ' ' 

such as CCD. and 4 is distance instrumentation section which consists of photo detectors 6. 
such as the light emitting devices 5. such as Light Emitting Diode, and a photo diode array, and a 
ens fo Z nc instrumentation 7. Moreover. 8 is the body a photograph of ,s taken^nd 9 is a 
synthetic vessel which compounds the signal of the image pck-up sect.on 1 and the distance 
nstrumentation section 4. The distance signal acquired by the picture s.gnal acquired by the 
image pck-up section 1 and the distance instrumentation section 4 is compounded wrth the 
synthetic vessel 9, and turns into a solid picture signal. 

[P 0 roblem(s) to be Solved by the Invention] However; in the above-mentioned conventional 
ex mT at least two independent optical system was required, and since that W-n-rt 
Somes expensive and the image pck-up section 1 and the distance .nstrumentat.on sect on 4 
werrsepS ihere was a problem that a creation of perfect X. Y. and the solid picture signal 
uuith the vector of the Z-axis was difficult . 
FoOOSl this^^ntion enables it to acquire a solid picture ^^^S^^ 
of such a point, and aims at offer of the solid vision camera wrth wh.ch still cheap and perfect X. 
Y, and the solid picture signal with the vector of the Z-axis are acquired. 

[Means for Solving the Problem] In the solid vision camera which outputs X Y and the solid 
p^ e gnal with the vector of the Z-axis in this invention in order to attain the above- 
mentbned purpose The optical system which connects a focus to an image pck-up element and 
rheTrementToned image pck-up elements, such as CCD, and the memory which records and 
pck-uP Picture image at any time. It has a neural netwoH, ; wrt a leammg 
Action and the control section which performs a control of each part, and when the 

S neural network guesses the image data recorded on ^J^^J^! 
from the image pck-up picture image. X. Y. and the sohd P .cture s.gnal wrth the vector of the 
axis are outputted. 

IwLnl After according to the above-mentioned configuration guessing th image data of the 
^^r^ZSL the image data by which a photograph of the neural network wrth 
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a learning function was taken after taking a photograph of a photographic subject with .mage 

" e ements such as CCD. through a lens and creating a solid p.cture ,mage by the pic ure 
image synthesizer, it changes and outputs to X. Y, and the sohd picture s.gnal with the v ctor of 
the Z-axis by 3D picture image converter. 

[Example] The example of this invention is explained based on a drawing. Dj™^ is an 

bbreviation block diagram of the solid vision camera of this invent,on_ {"™*^ 
elements, such as CCD which picturizes a body 8, 11 is the memory FRAM, PUSH, EEPROM. 
etc ) which records the picture signal of the image pck-up elements 2. such as CCD 12 ,s the 

eu aTnetwork who has a learning function. 13 is the picture image synthes.zer which compounds 
?he picture signal from a neural network 12. and 14 is 3D picture image converter which changes 

he d Picture signal from the picture image synthesizer 13 into the solid p.cture .signal wrthX 
Y and the Z-axis. Moreover, 15 is a system controller which controls each part. 10 n a lens, and 
X Y and the Z-axis show each vector shaft of 3-dimensional space. 
[0009] Next the hierarchical neural network (neuron network) who uses for th.s ,nvent,on ,s 

xptined A neural network is the information processing system which stated human being 
ne^us network. In a neural network, the model of the engineering neuron equivalent to a nerve 

[otl^Ttfeletnt of many inputs which are shown in «a*wl and one output is usually used 
or the unrt. On the other hand, it travels only to **, a certain weight (joint load™) ,s .ven, and a 
signal is inputted into a unit. The strength of the combination between unrts .s expres ed by this 
St The strength of the combination between units can be changed by learning. It is 
b utted after vat X which .engthened threshold theta from tot,. c£ eac nnpu (wj 0 to 
which weight was given receives deformation by response-funct.on f (X). Output value y ot 
unit becomes like the formula (1) shown below. 
[0011]y=f(X)...(D 

the unit deforms according to response-characteristic f 00 of a 
r!t S a gmoid Action which being well used as a response Unction shows ,n d^_3 . 
[001 3 In the hierarchical neural network, as shown in drawing 4 . each unrt (balloon ,n this 
Eg i hierarchized by the input layer L1. the interlayer (it consists of one ayer o two or 
more layers) L2 and the output layer L3. The connection between units « the connection 
Seen each class there is no connection within the same layer, and a s,gnal ,s transmitted 
onH^cltSnU^ of an output from an input. Usually, the unit of the input ayer L1 has 
nlher a sigmoid property nor a threshold, but an input value appears in an output as t is. A 
^network's output value is expressed wrth the very easy type wh,ch « shown ,n the 
following formulas (2). 
[0014] 0=f (sigmaVj and Hj-gamma) ... (2) 

tL lutout m of the unit of the output layer L3 : The joint load Vj to unrt , of the input layer LI 
U unit j Joint load thetaj to the unrt of an integer's L2 unrt j to the output 
ayer L th es Id gala of the .integer's L2 unit j : ThreshCd M of the output layer L3 : 

[ [ of The uni? of the input layer L1 ] N : It is the number of « 
0015] As the above-mentioned hierarchical neural network's learn.ng algorrthm the error back 
ro a aton .earning rule (back propagation) to which the joint load and 

interlayer L2-output layer L3 and the input layer LHnterlayer L2 are changed one by one us.ng 
fsTeeoes ; descent method is well used so that the square error of a teacher s.gnal and an 
oZtZTw l™ as the minimum, this error back propagation .earn.ng - a ru e back 
^agaS - L neural network who can realize a high recognrt.on rate cam to be eas.ly 

^^^EXL*. F,rst - a ph tograph of the body VT t; t tographic 

ub e t is^k- by the image pck-up elem nts 2. such as CCD, through a .ens 1* « , *o- 
dimensional picture signal is outputted from the image P ck-up elem nts 2. such as CCD. and .t is 
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inputted into a neural network 12. To a neural network 12. the past image data other than th s 
wo-dimensional picture signal is incorporated from memory 11. A neural » 
hat it may s ttle in the stable state corresponding to a near pattern (analogy) soon **** L wh.l 
memorizing some input configurations as a stable state of the system of a network and 
remembering that a strange input configuration is given ]. . , ■ J( 

017] That is. the neural network 12 with learning algorithm guesses an .formation reared for 
c e t on of the above-mentioned image data to a solid picture ,mage from past learn.ng and 
de ivers a signal to the picture image synthesizer 13. And the p.cture ,mage synthesizer 13 
compound, the guessed picture signal, and outputs a solid picture s.gna. requ.rec I for. o d 
picture image. The outputted solid picture signal is changed and outputted to X. Y, and the solid 
oicture signal with the vector oftheZ-axis by 3D picture image converter 14 

K T e mode of a creation of the solid picture image of doll a is s own ,r , « , 
ransverse-plane picture image b of doll a. side face p.cture image c tooth-back p.cture image a. 
n S face picture image e are given as teacher data. And these data are recorded memory 
11 Next if th two-dimensional picture image of doll a. s p.ctunzed from then mage pek up 
elements such as CCD. a neural network 1 2 will guess automatic y from t e , two- .mens.onal 
Pierre image of this doll a. and will send into the picture image synthes.zer 13 the data of do I 
horded on memory 11. Based on these data, the picture image synthes.zer 13 creates the sol.d 
pSre image of do7 a. Thus, the solid vision camera of this invention can create a sol.d p.cture 
image. 

fEffect of the Invention] The optical system which connects a focus to an image pek-up element 
and image pck-u P elements, such as CCD. as mentioned above accord.ng to th.s .nven ton. Wtan 
t has the memory which records at any time and reproduces an -mage pek-up p.cture mage a 
neural network wfth a learning function, and the control section wh.ch performs a control of each 
n!r a ndTneu^ network guesses the image data recorded on the aforementioned memory from 
he imate pek-u picture image Since X. Y, and the solid picture signal with the vector of the Z- 
axL Tre outputted enabled to acquire a solid picture signal w*h one optical system, an the 
X" ion camera with which still cheap and perfect X. Y. and the solid p.cture signal wrth the 
vector of the Z-axis are acquired can be offered. 
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